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Several authors ty^Q have implied that the original inspiration for Parrondo's games was 
a physical system called a "flashing Brownian ratchet felpl" The relationship seems to 
be intuitively clear but, surprisingly, has not yet been established with rigor. 

The dynamics of a flashing Brownian ratchet canbe described using a partial dif- 
ferential equation called the Fokker-Planck equation M, that describes the probability 
density, of finding a particle at a certain place and time, under the influence of diffusion 
and externally applied fields. In this paper, we apply standard finite-difference methods 
of numerical analysis Jjj|-|lo| to the Fokker-Planck equation. We derive a set of finite 
difference equations and show that they have the same form as Parrondo's games. This 
justifies the claim that Parrondo's games are a discrete-time, discrete-space version of a 
flashing Brownian ratchet. Parrondo's games, are in effect, a particular way of sampling 
a Fokker-Planck equation. Our difference equations are a natural and physically moti- 
vated generalisation of Parrondo's games. We refer to some well established theorems 
of numerical analysis to suggest conditions under which the solutions to the difference 
equations and partial differential equations would converge. 

The diffusion operator, implicitly assumed in Parrondo's original games, reduces to 
the Schmidt formula for the integration of the diffusion equation. There is actually an 
infinite continuum of possible diffusion operators. The Schmidt formula is at one extreme 
of the feasible range. We suggest that an operator in the middle of the feasible range, 
with half-period binomial weightings, would be a better representation of the underlying 
physics. 

Physical Brownian ratchets have been constructed and have worked |Q-lla|. It is 
hoped that the finite element method presented here will be useful in the simulation and 
design of flashing Brownian ratchets. 
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1. The Fokker-Planck equation 

One of the classical problems of statistical physics, and physical chemistry, is to 
find a macroscopic statistical description for the diffusion of a dissolved molecule 
or ion in a uniform fluid solvent. The microscopic state of such a system has very 
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many degrees of freedom, possibly even more than an Avogadro number of degrees 
of freedom. This gives rise to an equally large number of coupled equations of 
motion. It is completely impractical to solve such a large system with rigor. We 
must abandon the idea of an exact solution. We are forced to use a statistical 
description, where we can only describe the probability of certain events. 

We denote the probability of finding a Brownian particle at a certain point on 
space, z, and time, i, by p — p (z, t). The time-evolution of p (z, t) is governed by a 
partial differential equation called the Fokker-Planck equation: 

(D (z, t) p(z,t))-^ (a (z, t) p (z, t)) - ^p (z, t) = . (1) 

The functions a (z, t) and D (z, t) are referred to as the infinitesimal first and 
second moments of diffusion. In practice, the infinitesimal second moment does 
sometimes depend on concentration of the solute, p(z,t), but is usually regarded 
as constant and is called the "Fick's law constant." A typical value (for a hydrated 
sodium ion in water) would be of the order D ps 1.3 x 10~ 9 m 2 s _1 . The infinitesimal 
first moment depends on the magnitude of externally imposed forces and on the 
mobility of the Brownian particle which is given by 

(2) 



6TTT]a 

where Z e is the electrical charge on the particle, 77 is the kinematic viscosity of the 
solvent and a is the effective radius of the particle. A typical value for the mobility 
(of a hydrated sodium ion in water) would be u as 51.9 x 10~ 9 rn 2 s _1 volt~ . Further 
descriptions and numerical data may be found in books on physical chemistry and 
statistical physics |ili|-|l9|]. If we apply an electrical potential, or voltage, of V (z, t) 
then the infinitesimal first moment is given by 

d 

a (z,t) = ~u—V(z,t) . (3) 

The theory behind Equations || and |^ is due to Stokes and Einstein |2(J . More 
information about the methods of solution and the applications of the Fokker-Planck 
equation can be found in Risken [Q. 

When we take into account the functional forms of D and a then we can rewrite 
the Fokker-Planck equation as: 

d 2 p da dp dp 
az l oz az at 

This is the form of the Fokker-Plank equation which we will sample at regular 
intervals in time and space, to yield finite difference equations. 

2. Finite difference approximation 

Many Partial Differential Equations, or PDEs, including Equation Q can be very 
difficult to solve analytically. One well established approach to this problem is to 
sample possible solutions to a PDE at regular intervals, called mesh points M. The 
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true solution is approximated locally by a collocating polynomial. The values of the 
derivatives of the true solution are approximated by the corresponding derivatives 
of the collocating polynomial. 

We can define local coordinates, expanded locally about a point (zo,to) we can 
map points between a real space (z,t) and an integer or discrete space Time, 
t, and position, z, are modelled by real numbers, t,z € TZ and the corresponding 
sampled position, i, and sampled time, j, are modelled by integers i,j E Z. We 
sample the space using a simple linear relationship 



(z,t) = Oo + i\,t + jr) 



(5) 



where A is the sampling length and r is the sampling time. 

In order to map Equation |] into discrete space, we need to make suitable fi- 
nite difference approximations to the partial derivatives. The notation is greatly 
simplified if we define a family of difference operators: 



Aij = p(z + iX, t + jr) - p (z , t ) 



(6) 



In principle, this is a doubly infinite family of operators but in practice we only 
use a small finite subset of these operators. This is determined by our choice of 
sampling points. This choice is not unique and is not trivial. The set of sam- 
pling points is called a "computational molecule Q." Some choices lead to over- 
determined sets of equation with no solution. Some other choices lead to under- 
determined sets of equations with infinitely many solutions. We chose a compu- 
tational molecule called "Explicit" computation with the following sample points: 
{(0,0), (-1,-1), (0,-1), (+1,-1)}. 
We also need to make a choice regarding the form of the local collocating polyno- 
mial. This is not unique and inappropriate choices do not lead to unique solutions. 
A polynomial which is quadratic in z and linear in t is the simplest feasible choice: 



p (z, t) = p (z , t ) +A\-{z- zo) + Ai ■ (z - z ) +Bi-(t- t ) 



(7) 



where Ai , A 2 and B\ are the real coefficients of the polynomial. Equations ||, ^ and 
^ imply a simple system of linear equations that can be expressed in matrix form: 



-A +A 2 

+A +A 2 



A x ' 




" A_i,_i 


A 2 




A ,-i 


Si 




A+i,-i 



(8) 



These can be solved algebraically, using Cramer's method to obtain expressions for 
Ax, A 2 and B x : 

A ^ = P (fo + A, t - r) - p (zp - A, t Q - t) ^ 



and 



and 



2A 



p (zp - X,t - t) - 2p (z , t - t) + p (zp + A, tp - t) 
2A 2 

p(z ,t ) -p(zo,t - t) 
tSx — . 



(10) 

(11) 
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These are all intuitively reasonable approximations but their choice is not arbitrary. 
Equations [| [l(], [ll] form a complete and consistent set. We could not change one 
without adjusting the others. We can evaluate the derivatives of Equation [?] to 
obtain a complete and consistent set of finite difference approximations for the 
partial derivatives: 

dp p(z + A,t - t) -p(zo - A, t - t) 

Yz- Al - 2A (12) 

and 

d 2 p . p(z Q - A, t - r) - 2p(z ,t - r) +p(z Q + A,t - r) 

w = 2M ~ y (13) 



and 



g- t =Br = . (14) 



We can apply the same procedure to a (z, t) to obtain 

da a(z + A, t - t) - a(z - A, t - r) 

= = 2A • (15) 

Equations [l2[ Q |lj and |l5| can be substituted into Equation |J to yield the 
required finite partial difference equation: 

p (z , t ) = a-x -p (z - A, t - t) + a ■ p (z a , t - r) + a +1 -p(z + A, t - r) (16) 

where 

Dt i a{z ,t )T 

a _ _ A 2 T 2A j- 17 \ 

_1 q(zo+A,to-r) — q(zo— A,tp-T) . , >■ ' 

2A 



and 



and 



23? + I 

"V + i 



fl ° a{z +X,t -r)-a(z -X,t -T) , . - ( 18 ) 



2 A 



Dt _ a(zo.to)7 



«+i = ? m, X \ — r^ri s ■ (19) 

2A 

We can overload the arguments of p and write them in terms of the discrete space 
using the mapping defined in Equation]^. 

Pi,j = a-i ■ Pi-ij-i + a ■ Pi,j-i + a+i ■ Pi+i,j-i ■ (20) 

The meaning of the arguments should be clear from the context and from the use 
of subscript notation, Pij, rather than function notation, p(z,t). Equation ^0| is 
precisely the form required for Parrondo's games. 
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3. Parrondo's games 

In the original formulation, the conditional probabilities of winning or losing depend 
on the state, i, of capital but not on any other information about the past history 
of the games: 

• Game A is a toss of a biased coin: 

Pwin = ~ - e (21) 

where e is an adverse external bias that the game has to "overcome". This 
bias, e, is typically a small number such as e = 1/200, for example @,||- 



• Game B depends on the capital, i: 

If (i mod 3) = , then the odds are unfavorable. 



Pwin = - e (22) 

If (i mod 3) ^ , then the odds are favorable. 

3 

Pwin = ^ e ■ (23) 

It is straightforward to simulate a randomized sequence of these games on a com- 
puter using a very simple algorithm M . 

3.1. Game A as a partial difference equation 

We can write the requirements for game A in the form of Equation ^o|. 

Pi,j = f ~ - ej ■ Pi-i,j-i + • pij-t + Q + e^j ■ Pi+ij-i ■ (24) 

This implies a constraint that ao — which implies that Dt/X 2 = 1/2 which defines 
the relative scales of A and r so we can give it a special name: 

Dt 

The constraints on a_i and a+i imply a value for Parrondo's "e" parameter: 

€= {^} a(z °' to) (26) 

which can be related back to an externally imposed electric field, E = —dV/dz 
using equations |^ and ||: 



A \ / Z e \ ( dV 



AD J \ Qurja J \ dz 



(27) 



The small bias, e, is proportional to the applied external field which justifies Par- 
rondo's original intuition. 
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3.2. Game B as a partial difference equation 

There is still zero probability of remaining in the same state which implies a con- 
straint that ao — which implies that we still have the same scale, 8 = If we 
are in state i then we can denote the probability of winning by 
qi = P (win|initial position is i). We can write the difference equations for game B 
in the form: 

Pi.j = Qi-i -Pi-i.j-i + -Pij-i + (1 - qi+i) -Pi+i.j-i ■ (28) 
which, together with Equations [I?], |l8| and [19], gives 



Qi-l _ a -i _ 1 + 2Dr a hi 



1 - qi+i a + i 1 - 



(29) 



2Dr"'J 



which implies that 



j gi-l ~ (1 - Qi+l) 
Qi-i + (1 - U+l) 



%j = 2X8^ ; W1 . (30) 



This can be combined with Equation [| and then directly integrated to calculate the 
required voltage profile. We can approximate the integral with a Riemann sum: 



so we can construct the required voltage profile for the ratchet which means that, 
given the values of it is possible to construct a physical Brownian ratchet that 
has a finite difference approximation which is identical with Parrondo's games. We 
can conclude that Parrondo's games are literally a finite element model of a flashing 
Brownian ratchet. 

We note that game B, as defined here, is quite general and actually includes 
game A as a special case. 

3.3. Conditions for convergence of the solution 

We would like to think that as long as (3 — Dt/X 2 is preserved then the solution 
to the finite partial difference equation would converge to the true solution of 
the partial differential equation as the mesh size, A goes to zero. Fortunately, 
there is a theorem due to O'Brien, Hyman and Kaplan plj which establishes that 
the numerical integration of a parabolic PDE, in explicit form, will converge to the 
correct solution as A — > and r — > provided 8 < \. Similar results may also be 
found in standard texts on numerical analysis |q-|l0[| . 

We see that Parrondo's choice of diffusion operator, with 8 = | is at the very 
edge of the stable region. 

3.4. An appropriate choice of scale 

There is a possible range of values for 8. As 8 — * we require the time step 
t — > which means that the number of time steps required to simulate a given time 
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interval, T, increases without bound ^Vgteps = T/t ^ oo. It is computationally 
infeasible to perform simulations with very small values of p. On the other hand, 
the value of (3 = 1/2 implied in Parrondo's games is at the very limit of stability. 
In fact, the presence of small roundoff errors in the arithmetic could cause the the 
discrete simulation to diverge significantly from the continuous solution. 

We propose that choosing (3 — 1/4, in the middle of the feasible range, is most 
appropriate. If we consider the case of pure diffusion, with a = 0, then Equation 
[20| reduces to 

Pi.j = P ■ Pi-x,j-\ + (1 - 2/3) • Pi,j-i + p ■ Pi+i,j-i (32) 
and if we choose (3 = 1/4 then this reduces to 

_ 1 ■ Pi-id-i + 2 • pj,j-i + 1 ■ Pi+ij-i . . 

Pi,j ~ I V 00 ) 

which is the same as Pascal's triangle with every second row removed. The solution 
to the case where the initial condition is a Kronecker delta function, p^o = $i,o is 
easy to calculate: 



j_.(y\ = ±. m (34 ) 



which is a half period, or double frequency binomial. We can invoke the Laplace 
and De Moivre form of the Central Limit Theorem which establishes a correspon- 
dence between Binomial (or Bernoulli) distribution and the Gaussian distribution 
to obtain 

Pi,j = i CX P ( — — ) • (35) 

VMi) v 3 J 

This expression is only approximate but is true in the limiting case as j — > oo. 

In the case where a = 0; the Fokker Planck Equation [I] reduces to a diffusion 
equation: 

^ ^ ^ <») 

Einstein's solution to the diffusion equation is a Gaussian probability density func- 
tion: 

PM) = ^=expf^V) ( 37 ) 



where the variance, cr 2 , is a linear function of time: 

cr 2 = 2Dt . (38) 



It is possible to verify that this is a solution by direct substitution: 
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If we sample this solution in Equation |37] using the mapping in Equation g then we 
obtain Equation |35| again. This is an exact result. We conclude that the choice of 
[3 = 1/2 is very appropriate for the solution to the diffusion equation. We suggest 
that this would also be true for the Fokker-Planck equation, in the case where a is 
"small." The appropriate choice of 0, given arbitrarily large, or rapidly varying, a 
is still an unsolved problem. In general, we would expect that much smaller values, 
/3 — > 0, would be needed to accommodate more extreme choices of alpha. 

3.5. An example of a simulation 

We simulated a physically reasonable ratchet with a moderately large modulo value, 
M = 8. (The value for the original Parrondo's games was M = 3.) We used the 
value of j3 = 1/4. The simulation was based on a direct implementation of Equation 
pp| in Matlab. We chose a sampling time of r = 12 /zs and a sampling distance of 
A w 0.25^iin. The result is shown in Figure [j], where we indicate how the expected 
position of a particle can move within a Brownian flashing ratchet during four 
cycles of the modulating field. We can see a steady drift of the mean position of 
the particle in response to the ratchet action. This simulation includes a total of 




x 10" 3 



Fig 1. Time-evolution of the mean of the distribution p(z,t). When the field is asserted, 
the mean position of the particles moves in a generally "downward" direction. There is 
some relaxation towards the end of that part of the cycle. When the field is turned off, 
the mean remains constant although diffusion causes the field to spread. The total shift in 
mean position of this ratchet is very modest, about 0.005 /im, compared with the spacing 
between the teeth of the ratchet, of 2.0 fj,m. Part of the motivation of this work is to 
optimise the transport effect of the Brownian ratchet, subject to constraints. 

500 time samples. Note that the average rate of transport quickly settles down to 
a steady value, even after only four cycles of the ratchet. 
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4. Conclusions 

We acknowledge the similar, but independent, work of Heath [g2| et al. The focus 
of our paper is different. We seek to establish the physical, and mathematical, basis 
of Parrondo's games and to derive a practical numerical technique for simulation. 

We conclude that Parrondo's games are a valid hnite-element simulation of a 
flashing Brownian ratchet, which justifies Parrondo's original intuition. We have 
established that Parrondo's "e" parameter is a reasonable way to simulate a gradual 
externally imposed electric field, or voltage gradient. We have established that 
Parrondo's implied choice of the (3 parameter does lead to a stable simulation but 
we suggest that the choice of /3 = 1/4 is more appropriate from a mathematical 
point of view. 

Finally, we have generalised Parrondo's games, in the form of a set of finite 
difference equations ^ and we have shown that these can be implemented on a 
computer. 
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